What role does the third law of thermodynamics play in Szilard engines? 
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The role of the third law of thermodynamics in the Szilard engine has been addressed. If the 
ground state is non-degenerate, the entropy production defined as the work extract able from the 
engine divided by temperature vanishes as temperature approaches zero due to the third law. The 
degenerate ground state induced by the symmetry or by accidence gives rise to non-zero entropy 
production at zero temperature associated with the residual entropy. Various physical situations 
such as the SZE consisting of bosons or fermions either with or without interaction have been 
investigated. 
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I. INTRODUCTION 

Based upon the second law of thermodynamics Carnot 
proposed that every cyclic engines should consist of 
at least two reservoirs with two distinct temperatures, 
namely high and low temperature reservoirs. The for- 
mer supplies entropy accompanying heat into the engine, 
while the latter absorbs the supplied entropy to elimi- 
nate it from the engine. It has been shown, however, 
that the engine proposed by Szilard [l|, referred to as 
the Szilard engine (SZE), can be operated by using only 
a single reservoir, so that it was regarded as the so-called 
Maxwell's demon [2] which is believed to violate the sec- 
ond law of thermodynamics. The thermodynamic cycle 
of the SZE consists of three steps as shown in Fig. [TJ (A) 
to insert a wall so as to divide a box into two parts, (B) 
to perform measurement to obtain information on which 
side the atom is in, and (C) to attach a weight to the wall 
to extract work via isothermal expansion with a thermal 
reservoir of temperature T contacted. Now it is widely 
accepted that the SZE does not contradict the second law 
since the information entropy of the SZE is transferred 
to the reservoir via measurement and erasure mediated 
by the demon The second law thus forces us to 

directly relate information to physical entropy, which re- 
veals a profound role of information in nature. The SZE 
has been exploited to understand many physical prob- 
lems in various contexts [7-9] and realized in experiment 

(ioHil. 

The third law of thermodynamics, proposed by Nernst 
in 1906 [14], asserts that the entropy of a substance ap- 
proaches zero as temperature approaches absolute zero. 
This statement is true only if the ground state of the 
substance is unique. Otherwise, the entropy approaches 
non-zero finite value called as the residual entropy. Many 
quantum statistical behavior in low temperature, e.g. the 
specific heat of solids, is governed by the third law. How- 
ever, it is now found that the third law is a derived law 
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FIG. 1: (Color online) Schematic diagram of the thermody- 
namic processes of the SZE. Initially a single atom is prepared 
in an isolated box. (A) A wall denoted as a vertical grey bar 
is inserted to split the box into to two parts. The atom is 
represented by the dotted circles to reflect that we are lack 
of the information on which side it is before the measure- 
ment. (B) The measurement is performed, and one acquires 
the knowledge of where the atom is. (C) A load denoted by 
a filled rectangle is attached to the wall to extract a work via 
an isothermal expansion at temperature T. 



rather than a fundamental law. Interestingly there is 
no study on the relation between the information and 
the third law. Moreover, it has never even been asked 
what the role of the third law is in the context of the 
information heat engine, especially the SZE. In the clas- 
sical SZE, the entropy production defined as the work 
extracted from the engine divided by temperature is in- 
dependent of temperature. 

In this paper we show that the third law of thermody- 
namics manifests itself in the SZE, particularly in the low 
temperature. The entropy production is limited by the 
third law; the entropy production vanishes as tempera- 
ture approaches zero. Exception occurs when the ground 
state exhibits degeneracies either by accidence or due to 
symmetry. The entropy production then approaches a 
non-zero finite value completely determined by the num- 
ber of the degeneracies. Moreover, various non-trivial 
temperature dependence of the entropy production of 
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the quantum SZE containing bosons or fermions with 
or without interaction can be understood by considering 
the third law and such degeneracies. Through this paper 
we assume that all the measurement is performed in a 
perfect manner. How the imperfect measurement modi- 
fies the results of the classical SZE has been investigated 
in Ref. [l5|. The non-equilibrium effect in the classical 
SZE has also been considered in Ref. [16]. 

The rest of this paper is organized as follows. In Sec. 
II, we introduce the work formula of the quantum SZE 
and discuss one tricky point of when and how the mea- 
surement has been done during the thermodynamic pro- 
cess. Section III is the main part of this paper. We 
show the role of the third law in the SZE and present 
the simplest model, one particle SZE. In Sec. IV, we in- 
vestigate various physical situations of two particle SZE, 
which shows rich behaviors of a simple information heat 
engine in the low temperature. Finally, we conclude this 
paper. 



II. QUANTUM SZILARD ENGINE 

To correctly address the behavior of the SZE in low 
temperature, we should deal with it in a quantum me- 
chanical way. Recently it has been found by one of us 
that the work of the quantum SZE is expressed as [I^ 



N .X 

{W) = -kBT ^ In = kBTAS, 



(1) 



where Pm and represent the probability to find m 
atoms in the left side of the box among total N atoms 
right after a wall is inserted for the time-forward proto- 
col, and that for the time-reversed protocol, respectively. 
Here /c^, T and A^* denote the Boltzmann constant, the 
temperature of a heat reservoir and the entropy produc- 
tion, respectively. Recently we reported, however, that 
Eq. ^ itself can be derived from fully classical consider- 
ation. The partition functions, required to calculate Pn 
and p* , differ in whether the classical or the quantum me- 
chanics are taken into account [l8|. All the calculations 
performed in this paper are based upon Eq. ([T]). 

Now we would like to address one frequently asked 
question on the SZE: when and how the measurement 
process has been done during the thermodynamic pro- 
cess. The answer is that the measurement is automati- 
cally done by the reservoir when the box is completely 
separated into two parts by inserting a wall. It is noted 
that the process of inserting a wall should be performed in 
an isothermal way in the quantum SZE, which inevitably 
introduces the reservoir into the problem [l^ • In order to 
make the engine have a well-defined temperature at ev- 
ery moment the reservoir has to observe the eigenenergy 
of the engine so that each energy eigenstate is properly 
occupied following the canonical distribution. Below we 
show that such a measurement of the energy corresponds 



to that of the information on which part of box the par- 
ticle is located in when the wall is inserted. 

The engine and the wall can be modeled as an one- 
dimensional box and a potential barrier, respectively; 
that is. 



box 



if < X < L 
oo otherwise 



and 



V^Ml) = VoS{x-L/2), 



(2) 



(3) 



where Vq is the hight of the wall. For simplicity as- 
sume that temperature is negligibly small so that only 
the ground state is dominantly occupied. When Vq is 
large enough, the ground and the first excited state, de- 
noted as |0) and |1), respectively, are nearly degenerate 
so as to be almost equally occupied. Thus the density 
operator is written as 



/,= (|0){0| + |l>(l|)/2. 



(4) 



Now we introduce \L) which describes a localized 

state in the left (right) side of the box, as follows 



|L) = (|0) 
\R) = (|0) 

Explicitly \L) is written as 



|1»/V2 
\l))/V2- 



^/I/Lsm{2'Kx/L) if < a; < L/2 
otherwise 



(5) 
(6) 



(7) 



\R) can be given in a similar way with the probability lo- 
calized in the right side. One can then show that Eq. (|4]) 
is mathematically equivalent to 



p={\L){L\ + \R){R\)/2. 



(8) 



It means that the state is now represented as the proba- 
bility mixture of the left and the right side. It is thus no 
need to perform any additional measurement on which 
side the particle is in since it has already been done by 
the reservoir. When the wall is completely inserted the 
state of the engine is not a coherent superposition of two 
states \L) and \R) but rather their probabili ty m ixture. 
The similar argument can be found in Ref. [19], where 
once the wall is completely inserted the reservoir is con- 
tacted with the engine in order to perform the isothermal 
expansion. In our case, however, the reservoir should be 
contacted during the whole process of inserting a wall. 



III. THE ROLE OF THE THIRD LAW OF 
THERMODYNAMICS 

Here we prove that the entropy production, A^*, is 
bounded by the entropy of a system, which guaran- 
tees that AS vanishes as S vanishes. When the wall is 
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inserted, the entropy of the system is expressed as 

N 

S/ks = - ^ ^pm{n)\npm{n), (9) 

m=0 n 

where Pmip) represents the probabihty that the system 
has a discrete energy En when m atoms reside in the 
left side of the box, and N — m in the right. According 
to Pm{^) = PmP{^\^)^ where p{n\m) is the conditional 
probability that the system has an energy En, once m 
atoms are found in the left side, one finds 

S/kB = - ^Pm l^Pm + ^PmSn, > AS, (10) 

m m 

where Sm = — ^^p{n\m) In p{n\m). Here Sm > and 
— \npni > — \n{pm/p^) are exploited. As temperature 
approaches zero, the entropy of system S and accordingly 
AS approach zero due to the third law. 

Now we consider the SZE containing a single atom with 
the wall inserted at r = x/L, where x and L denote 
the distance between the wall and the left end of the 
box, and the size of the box, respectively. Here the box 
is modeled as an infinite potential well. It is shown in 
Fig. [2] that the entropy productions of the quantum SZE 
for various r vanish as T ^ except r = 0.5. Note 
that the entropy production of the classical SZE remains 
constant, i.e. a binary entropy A5'ci(r) = — rlnr — (1 — 
r) ln(l — r), independent of temperature. The deviation 
of the entropy production between the quantum and the 
classical SZE becomes prominent around ksT ^ ^sym = 
\E^ — E^\, where En^^^ denotes the nth eigenenergy of 
the left (right) side of the box (n = 1,2,---), namely 
E^ = h^in? /Smx'^ and E^ = /i^n^/8m(L — x)^, where h 
and m are the Planck constant and a mass of the atom, 
respectively. The reason is that if E^ is larger (smaller) 
than El the left (right) side of the box is predominantly 
occupied once ksT < Esym is satisfied. This is confirmed 
in the inset of Fig. [2l where AS* scaled by AS'ci(r) as a 
function of T scaled by £^sym coalesce with each other for 
all r, and all the curves start to bend at k^T / E^y^ ^ 1. 

It should be noted that it was reported in Ref. [l^ 
that the work of the quantum SZE is exactly equivalent 
to that of the classical one as far as a single atom is 
concerned. This statement is true only if the wall is in- 
serted precisely at r = 0.5, at which the ground state 
exhibits the degeneracy due to the reflection symmetry. 
The entropy production associated with this degeneracy 
exactly corresponds to the classical one, namely In 2. In 
a generic case, i.e. r ^ 0.5, however, the quantum result 
should deviate from the classical due to the third law. 

Let us discuss the meaning of the vanishing entropy 
production due to the third law in the context of in- 
formation entropy. As temperature goes to zero, only 
the ground state becomes dominantly occupied. For 
< r < 0.5, the ground state is located in the right 
side due to E^ > E^. Thus it is no doubt that the atom 
occupies the ground state of the right side at zero tem- 
perature so that the atom should be found in the right 
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FIG. 2: (Color online) /\S of the quantum SZE with a single 
atom as a function of kBT/Ei{L) for r = 0.5, 0.45, 0.4, 0.35 
and 0.3 from top to bottom, where Ei{L) = /i^/8mL^. (Inset) 
The same data scaled by ASci{r) for ^-aix and ^sym for x- 
axis. 



without any uncertainty. In the viewpoint of information 
the entropy is zero since there is no uncertainty for the 
location of the atom. It also means one cannot transfer 
any information or entropy to the reservoir by performing 
measurement and erasure. Therefore, the work cannot be 
extracted from the engine. 



IV. TWO PARTICLE SZILARD ENGINE 

If more than one atom is considered, the quantum sta- 
tistical nature such as bosons and fermions comes into 
play. However, the third law still governs the low tem- 
perature behavior of the entropy production. When the 
ground state of the system is unique, the entropy pro- 
duction of two atoms vanishes at zero temperature no 
matter what they are bosons or fermions. 



A. Particles without interaction 

In the case of bosons, the degeneracy of the ground 
state occurs when the reflection symmetry takes place, 
that is, £^sym = 0. The vanishing entropy produc- 
tion then becomes prominent for T < ^^sym, which is 
clearly shown in the inset of Fig. [3] presenting the en- 
tropy production of two non-interacting spin-0 bosons. 
Note here that there exists another energy scale AE = 
min {E2 — El, E2 — E^^}, at which the entropy produc- 
tion starts to increases as T decreases although it is not 
so dramatic in the inset of Fig. [3l This rather peculiar 
behavior is associated with the residual entropy (2/3) In 3 
appearing atr = 0.5atT = [l^, which is larger than 
the entropy production in the high temperature limit, 
namely In 2. As temperature decreases A^* first increases 
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FIG. 3: (Color online) AS* of the quantum SZE with two 
non-interacting spinless fermions as a function of k^T / Ei for 
r — 1/2 (the solid curve), 1/3 (the dashed curve), 0.25 (the 
dotted curve), and 0.2 (the dashed dotted curve) and (Inset) 
two non- interacting spin-0 bosons for r = 0.5, 0.45, 0.35 and 
0.25 from top to bottom, (a) The schematic diagram of energy 
levels at r = 1/3. The filled circle represents the ground state 
is occupied by one fermion while two dotted circles denote two 
possible ways the second fermion can occupy the next state. 
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FIG. 4: (Color online) AS* of the classical SZE of two distin- 
guishable particles with the attractive (the solid curve) and 
the repulsive interaction (the dashed curve) and of the quan- 
tum SZE of two spin-0 bosons with the attractive (the dotted 
curve) and the repulsive interaction (the dashed-dotted curve) 
as a function of k^T /Ei for r — 1/2. (Inset) /\S as a function 
of r at k^T /El — 0.05. The schematic diagram represents the 
energy levels of several configurations depending on r (See the 
text for the detail). 



around /S.E and then decreases around £^sys (See the 
dashed curve in the inset of Fig. [3j). Such behavior be- 
comes obscure when /S.E < £^sym (See the dashed dotted 
curve in the inset of Fig. [3j). 

Two fermions exhibit completely different behavior. It 
is shown in Fig.[3]that the entropy production of two non- 
interacting spinless fermions approaches zero even for r = 
1/2. The reason is that the ground state of two fermions 
is non-degenerate due to the Pauli's exclusion principle 
pjf . However, at r = 1/3 as temperature decreases the 
entropy production first decreases but finally approaches 
In 2 (See the dashed curve in Fig. [3]). This unexpected 
behavior is ascribed to the accidental degeneracy between 
the ground state of the left side and the first excited state 
of the right as shown in Fig. [3l^a). One fermion then 
occupies the ground state of the right while the second 
fermion is allowed to occupy either the left or the right, 
which contributes to entropy by In 2. 



B. Particles with interaction 

Let us now consider more realistic situations, namely 
two spin-zero bosons with either attractive or repulsive 
interaction and two spin- 1/2 fermions with either ferro- 
magnetic or anti-ferromagnetic interaction. It is not sur- 
prising that the results will become more complicated. 
However, the basic principle is the same as before: how 
the entropy production behaves in the low temperature 
limit is completely determined by the third law. Now we 
have one more energy scale, i.e. the interaction energy. 



Make sure that the work can still be expressed as Eq. ([T]) 
even if the interaction between atoms takes place. 



1. Spin-0 bosons with attractive or repulsive inertaction 

Here two interacting bosons are taken into account. 
For simplicity the interaction potential V for two bosons 
is modeled as follows: V = Vq, where Vq is negative 
(positive) for the attractive (repulsive) interaction, if two 
bosons are at the same side, otherwise V = 0. For the 
attractive interaction there exist two degenerate ground 
states for r = 1/2 at zero temperature giving rise to 
= ln2 since two atoms behave like a molecular pair 
by residing in the same side. This is indeed equivalent 
to the single atom case studied above, and becomes pro- 
nounced when ksT < |Vb|. The slight increase of A^ 
larger than In 2 (The dotted curve of Fig. |4]) is a clas- 
sical effect (See the solid curve of Fig. 2]). Even in the 
classical case it is more likely for two atoms to reside 
at the same side when the attractive interaction exists, 
from which configuration one can extract more entropy 
production than a non-interacting case. For the repul- 
sive interaction, the residual entropy at zero temperature 
is zero since for < Vq two bosons considerably re- 
pel each other like two spinless fermions discussed above 
(See the dashed-dotted curve of Fig. 2]). The similar be- 
havior can also be observed in classical case (The dashed 
curve of Fig. 2]). Note that these correspondences be- 
tween the quantum and the classical SZE are available 
only at r = 1/2. As r decreases from 1/2, the entropy 
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production at k^T / Ei = 0.05 rapidly vanishes for the 
attractive potential as shown in the inset of Fig. HJ For 
the repulsive potential, however, the maximum occurs at 
r ^ 0.47 since the accidental degeneracy between two 
configurations shown schematically in the inset of Fig. |4] 
can occur at Vq = Esym- 



2. Spin- 1 /2 fermions with anti-ferromagnetic or 
ferromagnetic interaction 

Now let us consider two spin- 1/2 fermions with spin- 
spin interaction modeled as 



V = VoSi'S2/h^ 



(11) 



where si and 5*2 represent the spin of each fermion, and 
Vb is a positive (negative) constant for anti-ferromagnetic 
(ferromagnetic) interaction. The interaction potential 
can be rewritten as 



V = Vo{Sy2h^ -3/4) 



(12) 



with S = si-\-S2. If no interaction is considered, there ex- 
ist six degenerate ground states for r = 1/2 at zero tem- 
perature; namely V^l(1)V^l(2) |0, 0), ^r{1)^r{2) \0,0), 
^+ |0,0), |1, 1), |1,0) and |1, -1), where ^l{r) 
and \S^M) denote the wavefunctions of the coor- 
dinate space in the left (right) side and those of 
the total spin states, respectively, and il)± represents 
(l/V2)[?AL(l)V^i?(2) ± ?AL(2)V^i?(l)]. It is noted that the 
work can be extracted only from two of them, that is, 
V^l(1)V^l(2) |0,0) and ^l) r{1)^1) r{2) |0,0), since the others 
have one fermion per each side giving rise to no pressure 
difference between two sides. This explains the entropy 
production approaches (1/3) In 6 rather than In 6 at zero 
temperature as shown in Fig. [5l 

As far as the anti-ferromagnetic interaction is con- 
cerned, six degenerate levels are split into two groups 
so that the energy of the spin singlets {S = 0), namely 
— 3Fo/4, becomes smaller than that of the triplets {S = 
1), namely Vb/4, as shown in Fig. [5ja). For k^T < Vq^ 
there exist three degenerate ground states instead of six. 
It gives rise to A^* = (2/3) In 3, where 2/3 reflects that 
the work is extractable from two cases among three [See 
the lower row of Fig. [5fa)]. For the ferromagnetic inter- 
action, on the other hand, the opposite occurs; that is, 
the energy of the singlets become larger than that of the 
triplets. Although again the degeneracy of the ground 
states at zero temperature is still three, the extractable 
work vanishes since there exists one fermion per one side 
in every configuration [See the upper row of Fig. [5fa)]. 
When the reflection symmetry is broken, i.e. r 7^ 1/2, 
the entropy production k^T / Ei = 0.05 rapidly vanishes 
for both the non-interacting and the anti-ferromagnetic 
cases as shown in the inset of Fig. [5l 

For the ferromagnetic case, however, the maximum oc- 
curs at r ~ 0.47. This might be associated with the ac- 
cidental degeneracy similar to that shown in the inset of 
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FIG. 5: (Color online) AS of the quantum SZE with two 
spin- 1/2 fermions with no interaction (the solid curve), the 
ferromagnetic (the dashed curve) and the anti-ferromagnetic 
(the dotted curve) interaction as a function of k^T / Ei for 
r = 1/2. (a) The schematic diagram represents the energy 
levels of the spin singlets [S — 0) and the triplets (5* = 1). 
(Inset) AS as a function of r at k^T/Ei — 0.05. 



Fig. m However, the story is not that simple. The ac- 
cidental degeneracy between two configurations, namely 
5 = and 5 = 1, presented schematically in the inset 
of Fig. [5l indeed occurs at r ~ 0.47. Since 5 = 1 is 
triple-degenerate while 5 = non-degenerate, the en- 
tropy production of such configuration is given as 



AS = -(1/4) ln(l/4) - (3/4) ln(3/4). 



(13) 



However, this is smaller than In 2, the maximum value of 
A5(r). 

Figure [6] schematically shows the configurations of en- 
ergy levels with r varied. The degeneracy between 5 = 
and 5 = 1 takes place at r = r^eg which satisfies 
^E{rdeg) = Esym{rdeg) - 1^0 = 0. By using Eq. (1) the 
entropy production can be written as 



A5 = -po Inpo -Pi Inpi, 



(14) 



where Pq = 1 and pi ^ 1 in zero temperature limit are 
exploited. Here we can safely assume P2 ^ 0, implying 
Po +Pi ^ 1 due to p2/pm ^ e-^^-/^^^ <C 1 as T ^ 0, 
in which Acm > denotes the energy difference between 
the configurations of two fermions and m fermions in the 
left side (m = 0, 1). Thus po and pi are given as 



1 



and 



Po 



Pi 



3e-^^A^^ + l' 



(15) 



(16) 



where 3 represents triple-degeneracy of 5 = 1 state. Once 
we have (5£^(rdeg) = 0, Eq. (p!3|) is recovered. 
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FIG. 6: Schematic diagram of the energy levels depending on r. Vo/Ei{L) = — 1 is taken leading to rdeg ^ 0.47. 




FIG. 7: AS as a function of r for kBT/Ei{L) = 0.1 (the solid 
curve), 0.05 (the dashed curve) and 0.01 (the dotted curve). 



As a matter of fact, Eq. (p!4|) is maximized by In 2 when 
Po = Pi = 1/2 or equivalent ly 5E/kBT = In 3 is satis- 
fied. It looks strange that the entropy production of the 
non-degenerate ground state is not equal to zero, and 



moreover exhibits the maximum possible value. This is 
ascribed to finite temperature effect. For a non-zero tem- 
perature, no matter how small it is, there exist r* max- 
imizing AS' by In 2 once SE/ksT = In 3 is fulfilled. As 
T ^ 0, r* approaches rdeg as shown in Fig. [71 Therefore, 
the maximum value of AS, In 2, in the inset of Fig. [5] is 
correct, and it occurs not at r = rdeg but at r = r*. 
V. CONCLUSION 



In summary, we have shown that the third law of ther- 
modynamics plays an important role in understanding 
the low temperature behavior of the SZE. When there 
is no degeneracy in the ground state the entropy pro- 
duction vanishes in the zero temperature limit. Various 
degeneracies generated from quantum statistical nature, 
symmetries, interaction, and accidence determine the en- 
tropy production in the low temperature, which limits the 
work extract able from the SZE. 
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